To fall out of a vessel.
Attach the buoys so they don't go overboard.
To go too far; to exceed reasonable bounds.
You can decorate the new room, but don't go overboard with surreal paintings.